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DETERMINATION OF A DEFINITION SCORE OF A DIGITAL IMAGE 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to the field of digital image processing 
5 and, more specifically, to methods of identification or authentication based on 
digital images of an eye. The present invention more specifically relates to the 
preprocessing applied to images of the same eye to determine a score 
characteristic of the definition of each image and, according to a preferred aspect, 
select that of these images which is the clearest. 

10 Discussion of the Related Art 

Iris recognition is a well tested biometric identification technique, 
provided that the image on which the analysis and identification methods are 
applied is an exploitable image. In particular, the performance of recognition 
algorithms strongly depends on the definition of the image of the iris to be 

15 identified. 

Now, in most applications, and especially in on-board applications 
(for example for an access control of a telephone or a laptop computer, for an 
electronic key, etc.), the used camera (digital sensor and lens) does not have an 
autofocus system adjusting the (real or simulated) focal distance according to the 
20 distance. 

Further, for obtaining a good resolution of the iris which only takes up 
a small surface area of the eye, the images are taken at a relatively short distance 
(generally on the order of from 10 to 30 cm). This results in a small field depth 
(distance range between the camera and the eye in which the image is clear). 
25 This small field depth added to the fact that the eye is spherical may even 
generate definition differences between areas of a same eye image. 
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A processing previous to the actual iris recognition thus consists of 
selecting a sufficiently clear image. 

Generally, the shooting device takes a number of images ranging 
between 5 and 50 and a pre-processing system selects the image to be submitted 
5 to the actual recognition algorithm. 

The definition evaluation amounts to assigning, to each image, a 
score characteristic of its definition. This enables either selecting a sufficiently 
clear image with respect to a determined threshold, or selecting the clearest image 
among the images of a set. By convention, the higher the score assigned to an 
1 0 image, the clearer the image. 

Various techniques for evaluating the definition of digital images have 
already been provided, be it based on a filtering, a wavelet transformation (WO-A- 
00/36551), or a frequency analysis (WO-A-00/30525). 

All these techniques have the common disadvantage of being slow, 
15 especially if they are implemented in miniaturized products where the processing 
capacity is limited (electronic key, for example). Slow means that they are poorly 
compatible with a real time processing of images taken at a rate greater than 10 
images per second. The need for rapidity is, in on-board applications, linked to the 
need for identification or authentication rapidity of a user by its iris, where the 
20 selection of a clear image thereof is a previous step. 

Another disadvantage is the complexity in terms of size of the 
program necessary to execute the definition evaluation algorithm. 

Another problem is, to save time and complexity of the method, to 
limit the area to be examined in definition. In particular, the small field depth 
25 associated to the fact that the eye is spherical and that elements such as 

eyelashes may be included in the image makes this area localization important to 
evaluate the definition of the iris and not that of other image areas. 

Another problem which is posed for the definition determination of 
iris images, or more generally of a specific area of an image taken with a small 
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field depth and acquired at small distance, is linked to the presence of areas 
external to the area to be evaluated (for example, eyelashes), which may be clear 
while the iris is not. This problem is especially present in operators or algorithms 
taking into account luminosity gradients, which amounts to taking more account of 
5 the contours than of the actual areas. In particular, this is a disadvantage of a 
conventional operator or algorithm known as an FSWM operator which is besides 
known as an operator providing acceptable results. 

Another problem which is also posed for the definition evaluation of 
image areas taken at small distance and with a small field depth is linked to the 

10 necessary illumination of the taken subject. For eye image sensors, it generally is 
a light-emitting diode. This light source creates specular spots which pollute the 
definition evaluation. In particular, the FSWN operator mentioned hereabove may 
be deceived by the presence of specular spots which tend to mask luminosity 
gradients originating from the iris with more significant gradients originating from 

15 the spots. 

BRIEF SUMMARY OF THE INVENTION 

One embodiment of the present invention provides a digital image 
processing method and system which overcomes one or several of the 
disadvantages of known methods. 
20 More specifically, the embodiment evaluates the definition of an iris 

of an eye or the like. 

The embodiment also selects, from among a set of eye images or 
the like, that which is the clearest. 

The embodiment also provides a simplified method of localization of 
25 an iris or the like in a digital eye image which is simple and consumes few 
calculation resources. 
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The embodiment enables approximate localization of a pupil or the 
like in a digital image in a simple, fast fashion, consuming few calculation 
resources. 

The embodiment determines a score characteristic of the definition 
5 of a digital image area comprising specular spots. 

The embodiment also makes a luminosity gradient analysis operator 
insensitive to the presence of parasitic contours in the area having its definition 
evaluated. 

One embodiment of the present invention provides a method for 
10 determining a score characteristic of the definition of a digital image, consisting of 
cumulating the quadratic norm of horizontal and vertical gradients of luminance 
values of pixels of the image, the pixels being chosen at least according to a first 
maximum luminance threshold of other pixels in the concerned direction. 

According to an embodiment of the present invention, said score is 
15 obtained by dividing the running total by the number of cumulated quadratic 
norms. 

According to an embodiment of the present invention, a current pixel 
having a vertical or horizontal gradient to be taken into account in the running total 
is selected only if the luminances of two pixels surrounding the current pixel while 

20 being distant therefrom by a predetermined interval in the concerned vertical or 
horizontal direction are smaller than said first luminance threshold. 

According to an embodiment of the present invention, said first 
threshold is chosen according to the expected luminosity of possible specular 
spots which are desired not to be taken into account. 

25 According to an embodiment of the present invention, to the interval 

between the current pixel and each of the pixels surrounding it is chosen 
according to the expected size of possible specular spots which are desired not to 
be taken into account. 
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According to an embodiment of the present invention, the quadratic 
norm of a gradient is taken into account in the running total only if its value is 
smaller than a predetermined gradient threshold. 

According to an embodiment of the present invention, the gradient 
5 threshold is chosen according to the image contrast. 

According to an embodiment of the present invention, a current pixel 
is selected to be taken into account in the running total only if its luminance is 
smaller than a second luminance threshold. 

According to an embodiment of the present invention, the second 
10 luminance threshold is chosen to be greater than the expected light intensity of a 
characteristic element contained in the digital image. 

According to an embodiment of the present invention, the image is 
an eye image. 

According to an embodiment of the present invention, said element 
15 is the iris of the eye. 

According to an embodiment of the present invention, the 
determination method is applied to one or several images of a set of digital images 
representing a same object. 

According to an embodiment of the present invention, the 
20 determination method is only applied to the images in the set which have 

successfully passed an approximate definition test based on the cumulating of the 
gradients in a single direction of the light intensities of the image pixels. 

According to an embodiment of the present invention, the score 
assigned to each image is used to select the clearest image from said set. 
25 An embodiment of the present invention also provides a system for 

determining the definition of a digital image. 

The foregoing objects, features, and advantages of the present 
invention will be discussed in detail in the following non-limiting description of 
specific embodiments in connection with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 

Fig. 1 very schematically shows in the form of blocks an example of 
an iris recognition system to which the present invention applies; 

Fig. 2 illustrates, in the form of blocks, an embodiment of the method 
5 for determining the score characteristic of the definition of an iris image according 
to the present invention; 

Fig. 3 illustrates, in the form of blocks, an embodiment of the iris 
localization method according to the present invention; and 

Fig. 4 illustrates, in the form of blocks, an embodiment of the method 
1 0 for calculating the score characteristic of the definition by searching weighted 
gradients according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

For clarity, only those elements and those steps that are necessary 
to the understanding of the present invention have been shown in the drawings 

1 5 and will be described hereafter. In particular, the structure of an iris recognition 
system has not been detailed, the present invention being implementable based 
on a conventional system, provided that said system can be programmed to 
implement the present invention. 

The present invention will be described hereafter in relation with the 

20 selection of the clearest iris image among a set of images. However, the present 
invention more generally applies to the determination of the definition of digital 
images or image portions exhibiting the same characteristics as an iris image and, 
especially, of images in which a first plane, the definition of which is desired to be 
determined, is at a different distance from a background. Further, although the 

25 present invention is described in relation with a complete example of a definition 
determination method, some phases of this method may be implemented 
separately and are, alone, characteristic. 
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Fig. 1 very schematically shows an example of an iris recognition 
system that can implement a selection method according to the present invention. 

Such a system is intended to exploit eye images to perform an 
identification or authentication by iridian recognition. For example, a digital sensor 
5 1 takes a set of images of an eye 0 of a subject. The number of images taken is 
generally of at least some ten images to enable performing the identification, after 
selection of the clearest image, while minimizing the risk of having to ask the 
subject to submit himself to a new series of shootings. As an alternative, the 
images to be analyzed originate from a distant source and may be pre-recorded. 

10 Sensor 1 is connected to a CPU 2 having the function, in particular, 

of implementing the actual iris recognition (block IR) after having selected (block 
IS), from among the set of images stored in a memory 3, the clearest image IN to 
be submitted to the recognition method. The selection method is based on the 
determination, for each image in the set, of a score characteristic of its definition. 

1 5 This determination is performed by means of the method of which a preferred 
embodiment will be described in relation with Fig. 2. CPU 2 is also used to control 
all the system components and, in particular, sensor 1 and memory 3. 

Fig. 2 schematically illustrates in the form of blocks a preferred 
embodiment of the definition determination method according to the present 

20 invention. 

The method of Fig. 2 comprises three separate characteristic steps 
which will be described successively in relation with the processing of an image of 
the set to be evaluated, knowing that all images in the set are processed, 
preferably successively, by this method. The selection of the image to which the 
25 highest score has been assigned is performed, for example, by simple comparison 
of the assigned definition scores, by means of a maximum score search step, 
conventional per se. 

A first preprocessing phase (block 4, Pre-focus) aims at eliminating 
very blurred images (more specifically, of assigning a zero definition score) which 
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will obviously be inappropriate for the iris recognition. This phase searches strong 
luminance gradients in the horizontal direction (arbitrarily corresponding to the 
general direction of the eyelids). Such gradients are linked to the presence of 
eyelashes, of abrupt grey level transitions between the pupil and the iris, between 
5 the iris and the white of the eye, between the white of the eye and the eyelid 
corner, etc. The more abrupt transitions there are, the clearer the image will be. 
Since a rough preprocessing is here to be made, the gradient search is preferably 
performed on an approximate image, that is, sub-sampled. 

Fig. 3 schematically illustrates in the form of blocks an embodiment 
1 0 of preprocessing phase 4. 

Original image I is first sub-sampled (block 41, Bidir Sampling) in 
both directions, preferably with a same factor. For example, the sub-sampling 
ratio is 4 in both directions, which amounts to approximating the image with a 
factor 16. 

15 Image SEI resulting from step 41 is then submitted to a filtering 

(block 42, Horiz Sobel Filtering) in a single direction, preferably horizontal to 
correspond to the direction of the main image lines. The filtering aims at 
calculating the horizontal gradient at each pixel, and thus of detecting the vertical 
contours. 

20 For example, it may be a unidirectional filtering known as the "Sobel" 

filtering. Such a filtering operator is described, for example, in work "Analyse 
d'images: filtrage et segmentation" by J-P. Cocquerez et S. Phillip, published in . 
1 995 by Masson (ISBN 2-225-84923-4). 

The image resulting from the filtering is then submitted to an operator 

25 (block 43, AF Compute) for computing the approximate definition score AF. In a 
simplified manner, this operator only calculates the sum of the intensities of the 
pixels of the filtered image. The higher the AF score, the clearer the image. 

Score AF calculated by block 4 is compared (block 44, Fig. 2, 
AF>TH) with a predetermined definition threshold TH. If the obtained score is 



8 



greater than the threshold, the definition determination process carries on with a 
second iris centering phase which will be described hereafter in relation with Fig. 
4. If not, the image is rejected (block 45, Score = 0) because not clear enough. 

Second phase 5 (Pupil Localization) consists of locating the eye 
5 pupil in the image to center the pupil (and thus the iris) in an image to be analyzed. 
This localization pursues several aims. A first aim is to subsequently concentrate 
the definition evaluation on the significant area. A second aim is to avoid areas of 
the image with a strong gradient (especially eyelashes), which are not in the same 
plane as the iris, which if taken into account in the definition evaluation, would 
10 corrupt this evaluation. 

Several localization methods may be envisaged. For example, a 
method based on a Hough transform associated with integral and differential 
operators, described in article "Person Identification Technique Using Human Iris 
Recognition" by C. Tisse, L. Martin, L. Torres, and M. Robert, published on Calgary 
15 Conference Vl'02 in May 2002, provides high performances. 

However, it has a high resource consumption and its execution time 
is thus not necessarily compatible with a real time processing. Further, for an 
evaluation of the definition, only an approximate localization is required. 

Fig. 4 schematically illustrates in the form of blocks a preferred 
20 embodiment of the pupil localization phase according to the present invention. 

Starting from original image I, lateral strips are first eliminated from 
this image (block 51, Vertical Cut). This elimination aims at not taking into 
account, subsequently, the dark edges (delimited by lines T on image I) of the 
image on its sides. If the eye is properly centered in the image, these strips result 
25 from the eye curvature which causes a lesser lighting of the edges. The size 
(width) of the eliminated strips depends on the resolution and on the size of the 
original image. Each strip is, for example, of a width ranging between one 
twentieth and one fifth of the image width. 
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The obtained reduced image Rl is then optionally submitted to a sub- 
sampling (block 52, Bidir Sampling) in both directions. For example, the sub- 
sampling is performed with the same ratio as for the preprocessing phase 
described in relation with Fig. 3. 
5 The average luminance of blocks of the sub-sampled reduced image 

SERI is then calculated (block 53, Mean Lum Block), the size of a block 
approximately corresponding to the expected size of the pupil in an evaluated 
image. This size is perfectly determinable since the processed images are 
generally taken while respecting a given distance range between the sensor and 
10 the eye. 

The computation is performed by displacing a computation window 
with a pitch smaller than the size of a block. The blocks overlap, the pitch in both 
directions between two neighboring blocks ranging, preferably, between one tenth 
and three quarters of the size of a block. 

1 5 For example, for images of 644*484 pixels in which the pupils fit 

within surfaces between approximately 50*50 pixels and approximately 70*70 
pixels, the luminance is calculated for blocks of 15*15 pixels (with a sub-sampling 
factor of 4 in each direction) by scanning the image with a displacement of the 
calculation window of from 2 to 5 pixels each time. An image LI of luminance 

20 values of the different blocks is then obtained. 

In this image, the block having the minimum luminance is searched 
(block 54, Min Lum Search). This block approximately corresponds to that 
containing the pupil (or most of the pupil). Indeed, the pupil is the darkest region. 

In the case where the sub-sampling is omitted, the number of blocks 

25 of which the average luminance must be calculated is higher. The displacement 
pitch of the calculation window is however reduced (for example, every 8 to 20 
pixels). 

Once the pupil has been approximately localized by its Cartesian 
coordinates (X, Y) in the image (block 55, Fig. 2), it is returned to the original 

10 



image I to extract therefrom (block 56, Extract) an elongated image El having the 
shape of a horizontal strip centered on the approximate position of the pupil and of 
a height corresponding to the average expected diameter of a pupil at the scale of 
the evaluated images. The fact that the entire iris is not reproduced in this image 
5 portion is here not disturbing. Indeed, this is not an analysis of the iris for its 
recognition but only an evaluation of its definition. This definition will be at least 
approximately the same over the entire pupil periphery and an analysis in a 
reduced strip containing the iris on either side of the pupil is enough. 

The elongated shape of the selected strip enables taking into 
10 account the fact that the eye is often partly closed on a shooting. This then 
enables minimizing non-relevant contours (eyelashes, eyelids). 

Although an elongated rectangular image forming the definition 
examination window is the preferred embodiment, it is not excluded to provide an 
oval, or even square or round examination window. In the case of a square or 
1 5 round examination window, it will then be ascertained to size it to contain, around 
the pupil, a sufficient iris area for the definition evaluation. This area will however 
have to be preferentially deprived of contours such as those of eyelids, for 
example, by making sure that the eye is wide open in the image shooting. 

The assigning of a score characteristic of the definition to the image 
20 is then performed in a third phase (block 6, FSWM), based on elongated image El, 
resulting from the previous step. 

According to one embodiment of the present invention, an operator 
of improved FSWM type is implemented to process the images likely to contain 
specular spots. 

25 In fact, an FSWM operator calculates, for all the image pixels (here 

elongated image El), the sum of the quadratic norm of the horizontal and vertical 
gradients of luminance value medians. This amounts to applying the following 
formula: 
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ZigradViiJ)) 2 + {gradH(i,j)) 2 , 

/=OJ=0 

with: 

gradV(i j) = Med[Lum(i,j) t Lum(i+1 j) I Lum(i+2 j)] 

- Med[Lum(i,j),Lum(h1,j),Lum(i-2j)] l and 
5 gradH(ij) = Med[Lum(ij),Lum(ij+1) l Lum(ij+2)] 

- MedlLumOjJ.LumCij-IJ.LumOj^)], 

where Lum(i,j) represents the light intensity of the pixel of coordinates (ij) in image 
El of size n*m and where Med designates the median function, that is, the result of 
which corresponds to the median value of the luminances of the pixels in the set 

10 where the function is applied. 

An FSWM operator such as described hereabove is discussed, for 
example, in article "New autofocusing technique using the frequency selective 
weighted median filter for video cameras" by K.S. Choi, J.S. Lee, and S.J. Ko, 
published in IEEE Trans. On Consumers Electronics, Vol. 45, N°3, August 1999. 

15 According to one embodiment of the present invention, the sum is 

not calculated over all the image pixels, but is limited to some pixels chosen in the 
following characteristic manner. 

For the quadratic norm of a gradient of the median of an image pixel 
to be taken into account in the sum providing the definition score, the respective 

20 light intensities of the pixels at a given predetermined distance from the pixel, the 
gradients of which are calculated, are at least smaller than a first predetermined 
luminance threshold. This amounts to not taking into account (not accumulating in 
the summing equation of the FSWM operator) the vertical gradients of the pixels of 
coordinates (i,j) for which Lum(i,j+k)>SAT1, or Lum(i,j-k)>SAT1, and the horizontal 

25 gradients of the pixels for which Lum(i+k,j)>SAT1 , or Lum(i-k,j)>SAT1 . Number k 
(for example, between 2 and 10) is selected according to the image resolution to 
correspond to the average size of the transition between a specular spot and the 
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iris. Threshold SAT1 is chosen to correspond to the level of grey for which the 
image is considered to be saturated. 

The above condition enables eliminating the pixels belonging to a 
transition between a possible specular spot present in image El and the rest of the 
5 eye. The pixels bringing non-relevant gradients are thus not taken into account for 
the determination of the definition score. 

Preferably, an additional condition is that the horizontal or vertical 
gradients are, in absolute value, smaller than a gradient threshold GTH. In the iris, 
gradients are relatively small. However, this enables not taking into account 
1 0 gradients especially originating from eyelashes. The determination of threshold 
GTH depends on the image contrast and is smaller than the average of the 
expected gradients for eyelashes. 

Preferably, the light intensity of the pixel is smaller than a second 
predetermined luminance threshold SAT2. Threshold SAT2 is chosen to be 
15 greater than the light intensity expected for the iris, which is generally relatively 
dark (especially as compared to the white of the eye). 

As an alternative, the quadratic norm of the gradients is directly 
compared with threshold GTH (then chosen accordingly). Performing the test on 
the gradient before squaring it up however enables saving calculation time for all 
20 the eliminated gradients. 

The compliance with all the above conditions corresponds to a 
preferred embodiment which can be expressed as follows in an algorithmic 
description. 

Sc = 0, NbPix =0 

25 For all the pixels of recentered elongated image El scanned, for 

example, in a line scanning (j from 1 to m, for each i from 1 to n): 

lf[Lum(i,j+k)<SAT1 AND Lum(i,j-k)<SAT1 AND Lum(i,j)<SAT2 AND 
I GradV(i,j)| <GTH], then Sc = Sc + (GradV(i,j))2 and NbPix = NbPix + 1 ; 
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lflLum(i+kj)<SAT1 AND Lum(i-kJ)<SAT1 AND Lum(ij)<SAT2 AND 
I GradH(i,j)l <GTH], then Sc = Sc + (GradH(i,j))2 and NbPix = NbPix + 1; 
nextj; 
next i. 

5 Once all pixels have been processed, the definition score assigned 

to the image is computed as being: 

Score = Sc/NbPix. 
This weighting enables making the indexes of the different images 
subsequently comparable to one another. 
1 0 Preferably, in the application of the above operator, the vertical and 

horizontal gradients are, even for conditional tests with respect to threshold GTH, 
only preferentially calculated if the first three conditions (Lum(i+k,j)<SAT1 AND 
Lum(i-k,j)<SAT1 AND Lum(i,j)<SAT2) relative to light intensities are verified. 

It can thus be seen that many gradients are not taken into account in 
15 the sum providing the score, and are not even calculated. An advantage then is a 
considerable time gain for the determination of the image definition score. 

Another advantage is that possible specular spots no longer pollute 
the image definition evaluation. 

More generally, the method minimizes the number of computations 
20 to be performed on the pixels of an image, the definition of which is desired to be 
determined. 

Another advantage is that, as compared to an equivalent tool 
implementing conventional definition calculation methods, the method is faster to 
determine the scores characteristic of the definition of an image set. 
25 Another advantage is that, while simplifying and making digital 

processings applied to the images faster, it is more reliable than known methods 
as concerns the definition evaluation. 

It should be reminded that although the present invention has been 
described in relation with the selection of an image in which the iris is the clearest 



14 



among a set of digital images of an eye, it more generally applies to images 
analogous in form and/or in characteristics. Further, some phases characteristic of 
the discussed method may find applications without being included in the general 
process and solve specific problems, likely to arise in other processes. 
5 In particular, the pupil localization in an eye image has specific 

advantages and enables, alone, solving problems and disadvantages of other 
localization processes used in other methods and especially in actual identification 
and authentication methods. Another example of application relates to the 
detection of eye movements of a person in animated images (gaze tracking). 

10 Here again, the rapidity with which the method enables approximate localization is 
compatible with the real time processing of animated images. 

Further, the phase of determination of the actual definition score, in 
that it simplifies a known FSWM operator, may find other applications in methods 
of analysis of various textures for which similar problems are posed and especially, 

1 5 when very bright reflections are desired not to be taken into account. In such 
applications, a method for determining the score characteristic of the definition of 
an image exhibits characteristics independent from the other phases described, as 
an example of application, in the present description. 

Of course, the present invention is likely to have various alterations, 

20 modifications, and improvements which will readily occur to those skilled in the art. 
In particular, its implementation in software fashion by using known tools is within 
the abilities of those skilled in the art based on the functional indications given 
hereabove. Further, the thresholds, block sizes, reduction or sub-sampling 
factors, etc. will be chosen according to the application and to the type of images 

25 of which the definition is desired to be determined, and their determination is 
within the abilities of those skilled in the art. 

Such alterations, modifications, and improvements are intended to 
be part of this disclosure, and are intended to be within the spirit and the scope of 
the present invention. Accordingly, the foregoing description is by way of example 
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only and is not intended to be limiting. The present invention is limited only as 
defined in the following claims and the equivalents thereto. 

All of the above U.S. patents, U.S. patent application publications, 
U.S. patent applications, foreign patents, foreign patent applications and non- 
patent publications referred to in this specification and/or listed in the Application 
Data Sheetare incorporated herein by reference, in their entirety. 
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